Global Feedback & 
Input on the Facebook 
Oversight Board for 
Content Decisions 


A debt of gratitude is owed to all those who provided their 
candid feedback as part of our outreach on Facebook’s Oversight 
Board. We hope that this report stands as a testament to the 
willingness of partners, stakeholders, and individuals to give their 
time and thoughts to this undertaking, in support of a stronger, 


more transparent content governance system. 
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Foreword 


There are lots of calls, every day, for Facebook to take down, leave up, 
or put back up some piece of content on its platform. And every 

day Facebook tries to strike the right balance between safeguarding free 
speech and protecting people’s safety, between what is and what is not 
acceptable on our platforms across many continents and countries. 


The question then is: where do we draw the line? And more to the 
point: who decides? How does Facebook ensure its decisions are fair, 
transparent, and free from our own biases? And what remedy should 
people have when their content is taken down? 


We have the responsibility to set down rules. Like most platforms, 
Facebook has its Community Standards for what is and what is not 
acceptable to share on Facebook. To enforce those standards, we have 
thousands of people reviewing content everyday, across the world. We 
eave up speech that shares a perspective, furthers a debate, or levels 


a criticism, and take down hate, harassment, or harm. We miss things 
sometimes, and were always at work improving our systems. 


In recent years, however, academics, legal scholars, and technologists have 
argued that, with a scale as massive as Facebook’s, it is both impossible 
and possibly illegitimate for any single company to oversee such a variety 
of human expression and experience. They argue that Facebook alone 
cannot set the de facto global standard of free expression. We agree. 


In November 2018, Mark Zuckerberg first proposed the creation of a new, 
independent body that would decide matters of speech and expression 
on Facebook. In January 2019, we expanded on that proposal in a Draft 
Charter for an Oversight Board for Content Decisions, which outlined 


11 practical questions on issues including membership, independence, 
transparency, and public accountability. 


At first, this idea sparked real interest and, for some, cautious optimism. 
At the same time, we heard a fair deal of skepticism about what this 


body would be, how it would work, and whether or not it would actually 
improve things for Facebook's global community of users. People 


wondered whether it was possible for a company of our size to create 
an Oversight Board with real teeth and, more importantly, value. 


To address these concerns, we've spent the last six months holding online 
and in-person consultations. We've heard from more than 2,000 people 


from more than 85 countries. The people who've engaged with us have 
been diverse and global. They include academics at the top of their field, 
grassroots organizers committed to change, and everyday people who 
just want to help us address some really tough issues. I’ve been amazed at 
how willing organizations, experts, and users have all been in sharing their 
time, thoughts, questions, and concerns. 


Here's some of what we've heard. 


e First and foremost, people want a Board that exercises independent 
judgment — not judgment influenced by Facebook, governments, 
or third parties. The Board will need a strong foundation for 
its decision-making — a set of higher-order principles, informed 
by free expression and international human rights law — that it 
can refer to when prioritizing values like safety and voice, privacy, 
and equality. 


e Equally important are the details on how the Board will select 
and hear cases, deliberate together, come to a decision, and 
communicate its recommendations both to Facebook and the 
public. In making its decisions, the Board may need to consult 
experts with specific cultural knowledge, technical expertise, and 
an understanding of content moderation. 


e People want a Board that’s as diverse as the many people on 
Facebook. They would like Board members who are ready and 
willing to roll up their sleeves and consider how to guide Facebook 


to better, more transparent decisions. These members should be 
experts who come from different backgrounds, different disciplines, 
and different viewpoints, but who can all represent the interests 

of a global community. 


Today, we're publishing our initial report summarizing the commentary 
and feedback to date. We've listened, and we're considering all viewpoints 
as we move forward to develop stronger checks and balances, more due 
process, and increased transparency. 


To be clear: the Oversight Board will not solve all of Facebook’s problems. 
For example, the Board is not designed to hear decisions about News 
Feed ranking or artificial intelligence, although these are pressing and 
important issues. We believe that the best way to set the Board up for 
success is to focus it specifically on content governance. This, in itself, is 


a complex and difficult issue — one which requires external input from 
highly qualified experts. 


It will also take time for the Board to grow into its role. This body will not 
be able to hear millions — or even thousands — of requests for review, 
not at 40 members nor at 400. And though the Board may make mistakes, 
we are expecting that it will learn from them. 


Our task is to build systems that protect free expression, that help 
people connect with those they care about, while still staying safe online. 
We recognize the tremendous responsibility we have not only to fairly 
exercise our discretion but also to establish structures that will evolve 
with the times. 


Our challenge now, in creating this Oversight Board, is to shore up, 
balance, and safeguard free expression and safety for everyone on our 
platforms and those yet to come onto them, across the world. 


Mes Lh, l 


Nick Clegg 


Vice President of Global Affairs and Communication 


I. Introduction 


A. The Oversight Board in context 


Social media platforms — and their users — are shaping the contours of public 
discourse, of speech and the influence that comes with it. This process is dynamic 


and fluid; it is being played out on a global scale, with impact on billions of people. 


The responsibility to determine what can stay up and what must come down is an 
immense one, exercised through the establishment and enforcement of rules. Nearly 
all social media platforms have adopted a system that allows users to report content 


that they believe violate those rules. 


Facebook’s system is built around its Community Standards, a set of policies that 
govern what is allowed and not allowed on the platform. The proposed Oversight 
Board is intended to provide a layer of additional transparency and fairness to 
Facebook’s current system. The question of how it should be designed — and 
what it should govern — sits within a broader discussion about the role of content 


moderation generally, as well as the future of free expression online. 


In recent years, researchers have proposed new models for understanding systems 

of online content moderation. A new generation of legal scholars has argued that 
“platforms have developed a system that has marked similarities to legal or governance 
systems."' Thus, they need to be analyzed within “the perspectives of private 
governance and self-regulation.” * Academics and practitioners are increasingly leaning 
into the language of governance and the rules-based order — calling variously for 


a “Magna Carta for the web"? or a new “digital constitutionalism."* 


Content governance began with the adoption of a widespread practice: the user 

report. In 2014, user reporting — or “flagging” — was described as a “ubiquitous 
mechanism of governance” 
in the digital age." Indeed, 


- “flagging” has been widel 
The proposed Oversight Board is intended to provide od Mir MM E 
em f , adopted, with millions of 
a layer of additional transparency and fairness to Facebook’s T——M" 


current system. The question of how it should be by Facebook alone. However, 
designed — and what it should govern — sits within a broader EEE 
practice across the industry, 


discussion about the role of content moderation generally, creo 


as well as the future of free expression online. mechanism for “visible public 
discussion” — a gap that 


has been criticized for leaving 


“critical decisions about difficult content in the hands of a few unknown figures at 


social media companies.”’ 


This issue of transparency around content decisions has underpinned the discussion 
around — and backlash against — content moderation as it is currently practiced. The 
public most often becomes aware of the realities of content moderation only when 
specific pieces of content become controversial, revealing “the complex and fraught 
decisions being made behind the scene"? Because the enforcement of platforms’ rules 
and policies feels like a “complex web of nebulous rules and procedural opacity,” the 
power to determine who can say what — and how — seems like an “enormous cultural 
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power ... held by so few, and... largely wielded behind closed doors. 


Civil society organizations have responded in kind, calling for action to support 
transparency, ensure external oversight, and remediate what they see as opaque 
decision-making. For example, the Santa Clara Principles on Transparency 

and Accountability in Content Moderation call for “independent external review 
processes,” which could form “an important component for users to be able to seek 
redress” through appeals of platforms’ content decisions." Similarly, Article 19 has 
proposed establishing a multi-stakeholder and industry-wide “Social Media Council,” 


which shares some similarities with the Oversight Board proposed by Facebook.” 


Against this backdrop, in early 2018, Noah Feldman developed two white papers in 
early 2018 on internet governance, in which he proposed a “Supreme Court.” He 
argued that this body would respond to the need for an independent decision-making 


process based on a formal commitment to freedom of expression." 


This new entity would be designed to operate on top of Facebook's existing policy 
development, content review, and internal appeals processes. In that regard, it would 
aim to *provide opportunity for refinement of arguments and ideas in difficult cases... 
create a greater sense of openness, revisability, and participation... [and] conserve 
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resources ... for truly unusual and difficult cases. 


In response to feedback from stakeholders and the public, the Oversight Board 
has continued to evolve from the Constitutional Court conceptualized in Feldman's 
original paper, beginning with Mark Zuckerberg's first official announcement in 
November 2018." 


Core features from Feldman's white paper remain, and he has been advising Facebook 
on the Board throughout its development. Facebook has proposed that the 
Oversight Board will focus on providing independent, binding judgment on removing 
or permitting content, with individual cases being heard by panels.^ These panels 
would then issue public explanations of the Board's decision, while offering 
“interested parties the opportunity to be heard." " Most importantly, the primary 
objectives also remain the same: increased transparency, legitimacy of decision- 


making, and independent judgment. 


B. Facebook’s initial announcement 


In an interview with Vox in April 2018, Mark Zuckerberg first mentioned Facebook’s 
intention to develop a mechanism for *independent appeal," a structure that would 
provide a “second opinion" or “final judgment call" on content decisions.” 
Referencing Feldman's Supreme Court metaphor, Zuckerberg identified the need for 
users to have recourse to an external appeals process, which would supplement the 


company's own internal system of addressing user appeals, launched in April 2018: 


Right now, if you post something on Facebook and someone reports it 

and our community operations and review team looks at it and decides that 
it needs to get taken down, there's not really a way to appeal that. | think 

in any kind of good-functioning democratic system, there needs to be a way 


to appeal. And I think we can build that internally as a first step.” 


Zuckerberg situated the need for an external appeals process alongside Facebook's 
overall efforts to increase transparency and strengthen governance in the face of new 
global challenges. On transparency, for example, Facebook aimed to do a better job 
in communicating the steps the company takes to address violations of its rules.” For 
example, Facebook began to publish its biannual Community Standards Enforcement 
Reports, in May 2018.” 


Facebook also brought together teams from across the company to continue to make 


progress in this regard. As Guy Rosen, VP for Integrity, explained: 


"By 2018 we had started to make progress on making our systems more 
proactive in detecting harmful content, but Mark pointed out that building 
the best system wouldn't be enough — we also had to be open and build 

a lasting approach to governance. He pulled together a team to consolidate 
the strategy, which resulted in work such as the Oversight Board, appeals 
experiences, doubling down on our enforcement transparency reports and 


a push for more transparency initiatives." 


In November 2018, Zuckerberg published his *Blueprint for Content Governance and 
Enforcement,” which explained many of these efforts.” This post announced that 
Facebook would establish an independent oversight body by the end of 2019. As 
Zuckerberg explained, this body would provide “... a new way for people to appeal 
content decisions to an independent body, whose decisions would be transparent and 
binding" based on the belief that “Facebook should not make so many important 
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decisions about free expression and safety on its own. 


10 


C. Early assessments of Facebook’s proposal 


Early feedback ranged from considered skepticism to cautious optimism, and raised 
fundamental questions about the purpose, scope, operationalization, and impact of 
the proposed body: would Facebook commit to implementing the Board’s decisions 
or would this effort amount to little more than an “empty gesture”?™ Would the 
Board have the power to select cases by its own determination?* Would Board 
membership include as many viewpoints and perspectives as possible in order to 


ensure that it reflects Facebook's global community? * 


Zuckerberg's announcement sparked questions regarding Facebook's assumption of 
State-like functions. As one editorial put it: *Call it a court or call it, as Facebook now 
does, an oversight board, this company, by adopting a structure of government, is 
essentially admitting it has some of the powers of a government. The question is what 
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that means for the rest of us. 


Others found the government metaphor to be less troubling and argued that 
*[f]ollowing legal and constitutional values might enhance the legitimacy" of the 
Board.” One observer compared this initiative to a “constitutional moment 

for the social network, in which Facebook voluntarily hands over a portion of its 
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considerable power to an independent body. 


Still others worried about Facebook's motivations. According to critics, the creation 
of the Board is a way by which Facebook will *try and avoid government regulation for 
as long as possible." Concerns remain that the creation of an external body, charged 
with the final review of difficult content decisions, would simply become a mechanism 
for diverting responsibility away from Facebook. Although the company has clarified 
its intentions," the perception still holds that “Facebook wants to distribute some of 
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the unprecedented power it holds - and some of the blame it gets. 


At the same time, Facebook's proposal was also met with early, positive assessments. 
While calling for the company to “do much more,” one NGO stated that “Facebook’s 
proposal of creating an independent oversight board is an unusual gesture of humility 
that we, cautiously, welcome.” ” Along the same lines, others expressed hope that the 
proposed Board could address Facebook's *unprecedented size and power" by trying 


to devolve at least some limited power to the user community.” 


Overall, observers called for more details on how, exactly, this Oversight Board would 
work. Some academics found *the idea of a Supreme Court of Facebook [as] promising 
in theory"? Others stressed that it could “revolutionize online speech,” while also 
wondering “how the body's decisions will be implemented in Facebook’s day-to-day 
operations.” ** And “if handled well,” the Oversight Board “could represent an important 
new model for content moderation, providing a true counterbalance to the sometimes 
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hesitant, often techno-utopian mindset at Facebook and other major platforms. 


JUNE 27, 2019 


11 


Il. Global Consultation 


A. Release of a draft charter 


From across the spectrum of skepticism to support, the overarching theme remained 
the same: the “devil is [in] the details"? In response, Facebook published a “Draft 
Charter: An Oversight Board for Content Decisions” in January 2019. The company 
presented this document as a starting point for discussion and an exchange of ideas 


on how the Board could be designed and supported. 


Using a structure of 11 core questions, the Draft Charter (Appendix A) offers a 
potential way forward for a Board that would make up-or-down decisions on specific 
pieces of content, while also contributing to the policy development process at 
Facebook. It is structured around the following format: a key question to set up 
debate; a few “considerations” to take under advisement; and an approach suggested 
by Facebook as a basis for moving forward. Interested parties were called on to 
review the paper and provide feedback to Facebook in order to “incorporate the most 
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promising ideas into the final charter. 


Public commentary on the release of the Draft Charter 


“We feel this is an important first step, however, 
many essential questions remain. Much about 
the mechanics of this body needs to be 
specified. We need guarantees of real 
independence, as well as decision-making that 
conforms to international legal standards for 


freedom of speech.” 
- Reporters Without Borders 


“Facebook has not shown itself capable of 
making reasonable policy decisions related to 
things like hate speech and propaganda. It 
may be time for it to bring in the experts, and 


let someone else make the decisions.” 
- Tech Crunch 


“the oversight board seems particularly “That’s not to say there isn’t value in having 
ill-equipped to handle some of Facebook's an extra set of eyes on decisions that 
most pressing problems." Facebook's far-flung moderators sometimes 
- NY Magazine make in a matter of minutes if not seconds. 


But no team, no matter the size or scope, 


: . . . could ever adequately consider every 
“We think that in adopting a semi- 


viewpoint represented on Facebook." 


independent Oversight Board for Content . 
- Wired 


Decisions, Facebook is taking a step in the 
right direction." 
- Public Knowledge “It’s a good system to have in place—to 
ensure desperately needed oversight and 


. ! . accountability—but it still doesn't tackle 
“Whenever it does come into being, 


. : some of the most egregious day-to-day issues 
the oversight board could be crucial to 


plaguing the platform, like harassment, 
Facebook's future" 


- Engadget misinformation, and targeted violence: 


- Gizmodo 
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B. Launch of a consultation period 


Facebook began convening informal groups of stakeholders in October 2018, just prior 
to Zuckerberg’s announcement. After releasing the Draft Charter in January 2019, 
Facebook launched its official, global consultation process that ran until the end of 
June 2019. This consultation process consisted of two-day, 40-person workshops in six 


cities," 22 smaller-format roundtables around the world,” and a public call for feedback. 


More than 650 people from 88 different countries attended the workshops, 
roundtables, and town halls; in addition, Facebook spoke to more than 250 people 
through one-on-one meetings focused on the Oversight Board proposal. Altogether, 
these included experts from multiple disciplines in both the private and public sectors 
(e.g., freedom of expression, technology and democracy, the rule of law, journalism, 
child safety, civil rights, human rights protection, and others). Stakeholders from 
across the geographic, ideological, and policy spectrum — including vocal critics of 
Facebook — participated in these events. Facebook also sought feedback from 

the public to ensure that all those who could not attend an in-person convening could 


still engage and provide their feedback. 


How will the Board be formed? 


Draft Charter 


Consulting 
with experts 


Host global 
workshops & 
roundtables 


Feedback Report Final Charter Board Begins Operations 
e 
e e 
o e 
e o 
Identify potential Orientation for 
Board members Board members 
Solicit public Review input Make design Test Board operations 
proposals for | from external | decisions informed and decision-making 
Board design | sources by external input functions 
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Many of these convenings included decision-making simulation exercises, as well as 
dedicated sessions on the design of the Oversight Board.” These simulations 
allowed the participants, acting as Board members, to experience the complexities 
involved in content moderation. These exercises used some of Facebook’s most 


challenging cases as examples. 


Ensuring a Global Perspective 


ALLY people consulted through workshops, roundtables, one-on-one 
discussions, and an online public consultation 


© 8g countries represented e 28 workshops and roundtables 


M Pi 


e e 
e 
n b 
e 
e@ 
: Brussels, Belgium : Mexico City, Mexico : Taipei, Taiwan 
- São Paulo, Brazil - Warsaw, Poland + Istanbul, Turkey 
: Ottawa, Canada : Dakar, Senegal* : Dubai, UAE 
Workshop & y : Zagreb, Croatia - Singapore : New York, USA 
Roundtable Locations : Berlin, Germany : Bratislava, Slovakia - Norman, Oklahoma, USA 
: New Delhi, India - Johannesburg, - San Francisco, USA 
: Tel Aviv, Israel South Africa* : Washington DC, USA 
*To be held : Florence, Italy : Madrid, Spain 
: Nairobi, Kenya : Geneva, Switzerland 
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What happened? 


What is the 
central 
tension with 
this content? 


What did 
Facebook 
decide to do? 


Why might the 
Board discuss 
this case? 


Sample cases from in-person consultations 


These examples describe the types of issues that the Board might review and 


deliberate on as part of its adjudicatory functions. They also illustrate how content 


decisions can require difficult trade-offs. 


HARASSMENT 


A user shared a list of men 
working in academia, who 
were accused of engaging 
in inappropriate behavior 
and/or abuse, including 
unwanted sexual advances. 


The allegations, offered 
without proof or due 
process, specifically 
referenced other individuals, 
with the potential for real 
impact to their careers and 
personal lives. At the same 
time, these allegations were 
part of an ongoing protest 
movement to draw attention 
to unreported and often 
ignored inappropriate 
behavior and abuse. 


In this case, Facebook 
permitted the content to 
remain on the platform. 
In the end, Facebook 
prioritized voice, as this 
post drew attention to an 
ongoing social issue. 


A large number of people 
could be impacted by this 
decision in ways that are 
both personally tangible and 
have implications for 
broader social discourse. 
The Board could choose to 
review this decision to 
assess various tensions and 
ensure Facebook made the 
right decision. 


HATE SPEECH 


A Page that commonly uses 
memes and other forms of 
satire shared posts that 
used discriminatory 
remarks to describe a 
particular demographic 
group in India. 


At the edges of acceptable 
discourse, there is a thin 
line that separates strong 
speech from hate speech. 
This post was arguably 
intended to be satire, 
though it was difficult for 
some audiences to 
recognize this intention 
without additional 
information. 


In this case, Facebook 
determined on review 
that this Page was using 
purposefully incendiary 
language to satirize 
discriminatory views 

and provide a potentially 
important counter to 
real-world hate speech. 
Facebook determined the 


content should be restored. 


The Board could determine 
whether the content shared 
should in fact constitute 
satire, and more broadly, if 
extremely incendiary 
language should be 
considered within the 
bounds of satire. The Board 
could determine that the 
content should remain off 
the platform. 


PRIVACY & SAFETY 
VIOLATIONS 


A candidate for office made 
strong, disparaging remarks 
to an unknown passerby 
regarding their gender 
identity and livestreamed 
the interaction. Other 
users reported this due 

to safety concerns for the 
latter person. 


Facebook takes safety- 
related reports seriously, 
but because the person 
filming was a candidate for 
office, there may have been 
value in permitting this 
content to be viewed due to 
public interest. 


In this case, Facebook 
determined that protecting 
the individual who was 
identified in the video 
posted to Facebook 
outweighed the importance 
of this content as news in 
the public interest. 


It is challenging to 
determine when offensive 
content should be deemed 
newsworthy and in the 
public interest. The Board 
could choose to review this 
decision to ensure Facebook 
made the right call and 
provide additional clarity on 
when these lines are drawn. 


HATE SPEECH 


A government official 
suggested that a local 
minority group needed to 
be cautious, comparing 
that group's behavior to 
that of other groups that 
have faced genocide. 


A government officials 
perspective is noteworthy 
and important for ongoing 
discourse. At the same 
time, the officials 
comments were also widely 
understood — both locally 
and abroad — as something 
that could potentially incite 
violence against that group. 


In this case, Facebook 
determined the content 
should be removed because 
it used violent language 
against an ethnic group. 
Under Facebook’s policies, 
this is hate speech. 


The government official's 
comments were derogatory, 
but were also noteworthy 
with regard to an ongoing 
social issue. The Board could 
choose to review this 
decision to ensure Facebook 
made the right call. 
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Facebook also developed an open, online questionnaire designed to accept both 
quantitative and qualitative responses from the public. The feedback form was 
available in 13 languages,” and it remained open from April 1, 2019 to May 27, 2019.” 
The first part of the questionnaire consisted of a set of multiple-choice questions 
structured around the Draft Charter. The second part allowed for respondents to 
submit free-form essays on who should serve, how the Board would hear cases and 
make decisions, and what governance structure should be put in place to ensure 


independent judgment. 


In all, 1,206 people participated in this online questionnaire, 138 of whom also 

chose the option to submit additional essays. A summary report was prepared jointly 
by Baker McKenzie? and Facebook’s Research team focused on integrity issues. 
Completed in June 2019, this summary is included as Appendix B. All essays from 


respondents who agreed to have their essays shared publicly are included as Appendix C. 


Together with the responses gathered through the open, online consultation, 
Facebook’s extended period of feedback spurred civil society organizations, advocacy 
groups, and individuals to release their thoughts on the Oversight Board. These white 


papers and statements are included as Appendix D. 


The majority of commentators found Facebook’s process to be a welcome departure 
from standard practice. For example, 27 civil society groups and individuals signed a 
“Joint Statement,” which welcomes Facebook’s consultation on the Draft Charter.” 
Others described the *open process and consultations" as *maybe the most dramatic 
decision that we have seen from [Facebook] in the last few years, at least regarding its 
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content policy. 


On the other hand, some found this public consultation “not nearly iterative enough, 
nor transparent enough, to provide any legitimacy" to the process of creating the 
Board." This report seeks to provide more transparency by documenting the main 
lines of feedback from those who engaged in this consultation process. It also serves 
to inform Facebook's future decisions, as the company works toward a revision of the 
Oversight Board's Draft Charter. 


C. Research into existing oversight models 


In parallel with the public consultation process, Facebook undertook research to 
study the range of oversight models that exist globally. The resulting report 
(Appendix E) reviews community and institutional mechanisms for decision oversight, 
as well as a range of judicial and quasi-judicial models. Facebook's research identified 
six "families" of oversight design, which could be used to inform the establishment of 
the Oversight Board: investigative institutions, supervisory institutions, arbitral 


adjudication processes, administrative adjudication bodies, national judicial systems, 
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and international judicial systems. These "families* were assessed against autonomy 
of process, validity and salience of information considered, procedural fairness, 


transparency, and executability of outcome. See chart below. 


This research found that “there is no perfect system — all systems involve trade-offs 
and require prioritization based on overall goals." ? In other words, there is no “silver 
bullet for institutional design that will address all issues for all constituencies in all 
conditions." It also concluded that external awareness is key to legitimacy, and 
clearly communicating how priorities are set and what decisions are made can be just 
as critical as the specific decisions themselves.*' Thus, public reason giving will be a 
crucial feature of the Oversight Board, one which drives at the heart of the legitimacy 
of its decisions.” 


Key Trade-offs Across Process 
and Outcome Dimensions for Assessment tess Qo —$s 


EXAMPLE 


Autonomy 


Validity 


Salience 


Procedural 
Fairness 


Transparency 


Executability 
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INVESTIGATIVE 


Hospital incident 


FAMILIES OF OVERSIGHT MODELS 


NATIONAL COURT INTERNATIONAL 
SUPERVISORY ARBITRATION ADMINISTRATIVE SYSTEMS COURTS 
: A Socal Securit) Trad E 
Commercial/ Community EEE US Appeals/ French Court e T Pn 
em Appeals Council (US) : or Int'l human 
Institutional (eg, shura) S SCOTUS of Cassation 5 
or Special “Courts rights court 


Research Model 
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INPUTS 


DESIGN DECISIONS 
Member selection 
Member terms 

Support staff selection 
Case selection 


Source of authorities 
and powers 


EXECUTIVE 
SUPPORT 


Actual powers and 
authorities 


Functions and support 
provided by members 


Downstream impact of 
decisions 


Expected transparency 
of decisions 


© PROCESS © OUTPUTS © INPUTS © GOAL 

AUTONOMOUS PUBLIC TRANSPARENCY Institutional 
Free of undue influence ASSESSMENT Communicated clearly "e 

Fair and accurate and publicly legitimacy for 
PROCEDURAL decisions the Oversight 
FAIRNESS EXECUTABILITY Board 
Proper decision-making FACEBOOK Feasible to be 
procedures ASSESSMENT implemented ona 

Operationally feasible defensible timeline 
ACCURACY 


Based on correct facts 


and information 


SALIENCE 


Considers technical 


and operational 
constraints 


IIl. Summary of feedback 


Both the Draft Charter and the online, public consultation process were structured 
loosely around three issue areas: (1) membership; (2) decisions; and (3) governance, 
values, and independent judgment. The remainder of this report — structured 
around these three topics — will provide a public summary of the feedback collected 
during Facebook’s consultation period. This document is intended to guide Facebook 
as it continues to answer open questions about the design of the Board, prior to its 


actual establishment. 


A. Board membership 
I. SELECTION PROCESS 


Many of those who engaged in consultations expressed a degree of 
concern over a Facebook-only selection process, but feedback was split on 
an alternative solution. An intermediate "selection committee" to pick 


the Board could ensure external input, but would still leave Facebook with 
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the task of “picking the pickers.” There was broad agreement that 
transparency around the ultimate selection process will be key. 


The Draft Charter suggests that Facebook will select the first cohort of members, 
with future selection to be taken over by the Board itself. This option may be the 
most expeditious, given Facebook’s determination to see the Board operationalized 


by the end of this year.” 


However, many participants expressed concern that the Board would be less 
legitimate if Facebook itself was central to the Board member selection process.” 
Others questioned the proposal to leave future selection up to the Board itself, 
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as this could result in a “recursion problem” ™ and the “perpetuation of bias. 


A variety of counter-proposals followed that ranged in complexity and level of 
external input. Some recommended that membership be left to a fully democratic 
vote by Facebook users; others worried that a vote would open up the process up 
to pre-existing bias." Some advocated for a hybrid approach, combining selection 


procedures so that Facebook, outside groups, and users could all participate. 


Other suggestions varied. They included: soliciting public comment on a slate of 
applicants;” inviting civil society groups to select some of the Board members;^ 
asking governments to weigh in on names and candidates; opening a public 
nomination process;* and using a randomized lottery system to select members from 


among Facebook users.” 


One recurring proposal was the establishment of a selection committee, a 
recommendation that participants raised at each of Facebook's six regional workshops. 
To some, delegating this responsibility away from Facebook would provide a "critical 
layer of separation" on day one of the Board's establishment." An external selection 
body would help *eliminate any questions in people's minds" that the body might not 


be independent because Facebook had a hand in the selection of Board members.” 


At the same time, others recognized the efficiency of Facebook's proposed approach, 
which would avoid *the Kafkaesque process of drafting a separate committee to 

pick the ... committee.” ^^ Facebook would still have to determine which organizations 
and representatives would get a seat at the selecting table. Thus, a selection 
committee would not eliminate Facebook's influence, as the company “would still be 
picking the pickers."^' This process, some argued, may be “equally bad" * and not 


“worth the complexities" it would bring.” 


Furthermore, others warned Facebook not to get *bogged down by the notion that 

outsiders need to be part of [the] selection process. Facebook generally, as a company, 
needs to own more of its decisions, including this one.””” Should the company indeed 
select the first slate of members, as indicated in the Draft Charter, it will not only have 


to “own” this decision, but also any controversy that results from its choices. 


JUNE 27, 2019 


Inthe end, whatever selection method is chosen, the process for setting up the 
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Board should be fully transparent,” “in line with the implied openness of [Facebook] 
creating an Oversight Board.”” While “no choice is perfect,” Facebook should be 
open about its decisions on eligibility criteria and qualifications, as well as the ultimate 


process for selecting members.” 
Il. QUALIFICATIONS AND DIVERSITY 


All agreed on the importance of diversity, though perfect representation 
is not possible. Feedback was split on the need for candidates who 

have "name recognition" and high profiles. Debate exists over whether 
members should be active users of Facebook or, at least, familiar 

with social media. There is an expectation that members should serve 
the interest of the Facebook community as a whole, rather than 
specific constituencies. 


In the Draft Charter, the company committed to releasing a public list of qualifications 


for potential Board members." Additionally, as part of the member selection process, 


When considering the Board as a whole, respondents prioritized the 
following as extremely important: cultural and linguistic knowledge (5996), 
ideological or political views (4896), and race or ethnicity (4896). 


Cultural & linguistic Ideological or Race or ethnicity Professional Other characteristics 
knowledge political views background (e.g. gender, sexuality) 
O O O G 
6/76 ) 61% 46 x) 46 x) 
Nationality Educational background Religious views Income level 
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Facebook has stressed the importance of ensuring diversity, vis-a-vis geographic and 


gender balance, professional background, political viewpoints, and other characteristics. 


With only 40 members, it has been said that the Board “cannot hope to represent 
every single view on the balance between protecting free speech and regulating 
harmful speech.”” Nonetheless, many stressed the need for the Board's composition 
to reflect as many segments of society as possible. In addition to the aspects of 
diversity listed above, other suggestions included: national and religious minorities; 
victims or targets of online hate speech and harassment;” those with both technical 
and policy backgrounds;” and industry voices, including “key advertising industry 
associations." ^ Many interlocutors also urged Facebook to ensure that lawyers and 
legal experts not be over-represented on the Board.” They preferred that the Board 


focus on a multidisciplinary, multi-stakeholder approach to membership selection." 


Some favored candidates with high name recognition, who could lend credibility to 
the Board.* Others preferred a different approach, stressing that the Board “doesn’t 
need people with public profiles."* Instead, it should include expert-level candidates 
with demonstrable professional experience, a willingness to be *engaged and 


involved,” * and expertise in key fields of study. 


Regarding presence on the platform and familiarity with technology, feedback was 
split. Some strongly believed that all members "should have a Facebook account as 
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a requisite” since being a non-Facebook user “would make it harder to understand 
nuances of the platform."** Others felt that this would limit the likelihood of finding 
strong Board members who may be critics," and feedback was nearly unanimous in 


stressing the importance of having some Facebook critics on the Board. 


Above all, a general consensus emerged with regard to seeking out Board members 
who can serve all users, through an open, deliberative process.” Stressing, for 
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example, that the “the board is not a parliament,” ® many of those consulted 


discouraged a culture where members advocate for their particular constituency.” 

It would be “practically impossible" for the Board to “provide representation for all,” 
given the sheer diversity of users on the platform." Instead, it would be preferable for 
each member to serve “not on behalf of their organizations,” but as a representative 


of the entire Facebook community of users.” 
IIl. DISQUALIFICATIONS, CONFLICTS OF INTEREST, REMOVAL 


With some exceptions, interlocutors agreed that Facebook employees 
(current and former) should be excluded from the Board. They also 
agreed that Facebook should not have the power to remove members 
without cause, but sought more clarity on exactly what “cause” 

would include. Additional suggestions included having the Board 
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Number 
of Members 


A third of respondents (34%) 
stated the Board should be 


comprised of 21-40 members. 


A quarter (25%) stated the 
Board should be comprised 
of 20 or fewer members. 


Length of Tenure 


A quarter of respondents 
(26%) said that a three year 
tenure would be best. 


19% of respondents said 
that two-, four-, or five-year 


tenures should be considered. 


develop its own code of conduct, recusal process, and other 
accountability measures. 


Inthe Draft Charter, Facebook proposed that current and former employees not be 
eligible as Board members. This is a position that finds general acceptance, given the 
need for independence and credibility.” However, a minority view held that former 
Facebook employees should not be immediately disqualified, as the Board may benefit 


from an insider’s technical expertise and institutional knowledge.” 


Under Facebook's current proposal, the company would not be allowed to remove 
any members “except if the member has violated the terms of his or her 
appointment.”” Generally, this proposal met with agreement. However, observers 
called for increased specificity on these terms and for the Board itself to be involved 
in removal decisions.” Removal, it was argued, “should be based only on ‘reasons 

of incapacity or behavior that renders [members] unfit to discharge their duties, such 
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as serious grounds of misconduct or incompetence. 


Other suggestions for accountability varied. These included the establishment 
of an ethics subcommittee;* the development of a recusal process;? the disclosure 
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of financial (and other) conflicts of interest; "and the promulgation of a specific 
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code of conduct. 
IV. TERM LENGTHS AND PART-TIME SERVICE 


Feedback varied with regard to term lengths, the size of the Board, 
and part-time service. Some felt that the responsibilities of the 
Board necessitate full-time positions; others worried that a full-time 
requirement would hinder qualified candidates from serving. 


Facebook has suggested that Board members serve a fixed term of three years, 
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renewable once.” Other suggestions included varied term lengths; staggered 
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appointments; ^' and shorter term lengths, given the “rapid pace of change" in 
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content and technology." However, while some felt that three years was too long, 
others felt it was not long enough. The latter believed that more time is necessary for 
members to become acquainted with their responsibilities, as well as the complexities 


of content governance. 


Feedback was similarly split on the size of the Board. Facebook has suggested up to 
40 members on the initial Board, which would be global in nature and organized to 
operate and decide on cases in panels." Some felt this number was too small and 
expressed concern over “docket management" and “caseloads.” "* Others, 
conversely, found the number to be unwieldy and unmanageable."* Still others, on a 
more practical level, suggested that the Board include 41 members, in case a tiebreak 


would be required.'? 
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Debate also surfaced with regard to full-time or part-time service. Some wondered 
if the responsibilities in the Draft Charter were more ambitious than the part-time 


position originally envisioned by Facebook: 


As | was looking at the Draft Charter, it looks like these board members will have 
to select the cases they want to hear, write up decisions, write up dissents... 
they are also supposed to select the next slate of board members... it sounds 


like a pretty full-time job, if done well and thoughtfully and correctly." 


Some worried that a part-time arrangement could lead to a bias towards a certain 
type of people, such as academics and the financially independent, who are 

more likely to accept part-time positions."” Similarly, others expressed concern 
that part-time service would lead to the Oversight Board being dominated by 


its permanent staff.” 


Some, meanwhile, supported the Draft Charter’s part-time proposal, which would 
mean that members’ “livelihoods are not hinging on Facebook." "^ Separately, others 
pointed to the fact that most boards are part-time positions.'^ Given this expectation, 
some felt that, “if it’s not part-time, you’re going to drastically reduce the pool of 
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potential candidates. 


Should the Board ultimately entail part-time service, it will be necessary to manage 
expectations with regard to the number of cases the Board could review. Facebook’s 
own research points out that “workload management is particularly salient in part- 
time boards”, if mismanaged, the part-time nature of the work could “be a significant 
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limitation on their institutional capacity. 


Facebook has acknowledged this tension, while opening the possibility of Board 
membership evolving into a full-time commitment over time. As one company 
representative stated, “the caseload that they're likely to hear at least in the first 
couple years, is something more like one or two ... decisions a week ... [but] if 

it turns out that this is actually much more of a full-time job, that there's a huge 
array of matters that need to start going before this Board, I think that's an 


evolution that is possible after having got it started." "°? 


B. Content decisions 


I. REQUESTS FOR REVIEW 


Cases will come before the Board through two mechanisms: Facebook- 
initiated requests and user-initiated appeals. One open question is how 
the latter would be filtered; some prefer a democratic element (i.e, 
voting) while others do not. Commentators generally supported the 
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Board having the power to choose its own cases, as well as the 
establishment of transparent criteria for prioritizing and selecting cases. 
Feedback varied as to what that criteria should be. Those engaged 

in the consultation period expressed a strong preference for quality 


over quantity, in terms of caseloads and case review. 


The Draft Charter explained that cases will come before the Board through two 
avenues.'? First, Facebook itself will request review of pieces of content that are 
particularly “important and disputed." ™ Second, users will also be able to request 
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a review, after undergoing Facebook's internal appeals process. 


In some way, these requests for review will need to be filtered and prioritized, given 
the limited number of cases the Board will be able to hear. Some suggested opening 
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up case selection to public voting,” though others feared that well-organized 


groups could dominate the process at the expense of stakeholders with less influence 


and resources.” 


Feedback has generally supported a Board that retains “certiorari power” to 

select which requests for review that it wishes to hear — in other words, a Board that 
has the discretion “to control its docket.” ^ While a general consensus supports 

this view, some also believe this may result in the actual task of selection being left 

to the Board's support staff. ^* 

Thus, “selection criteria would need to be outlined in general terms in the Charter 
and specified by the independent board through transparent, internal guidelines.” 7 

If the expectation is for the Board to hear “contentious cases,” then it would be 
“important to define what a contentious case is." ° Given that difficult or contentious 
cases are a matter of subjectivity, the Board will “need basic requirements for what 
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types of cases [it] should hear. 


Feedback varied with regard to what those requirements and criteria should be. 
Suggestions included the following: a potential for real-world harm; ™ cases 
without precedent; ™ high-profile cases with international implications; ^ highly 


emblematic cases; ^ 


and content that deals with freedom of speech, hate speech, 
or terrorist propaganda.” A number of commentators asked about the Board's 
ability to group cases ^ — and whether it would hear “class action types of 
content issues, looking across a particular ecosystem of content" rather than 
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simply individual posts. 


Irrespective of how requests for review are surfaced, there is a strong preference 
for the Board to accept a smaller number of requests for review, in order to spend 
more time on each individual case. 7696 of respondents to Facebook's public 
consultation stated that dedicating more time and research to each case is more 
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important than making more decisions each year.” Workload management will 
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be critical, not only to avoid backlogs and ensure quality reviews, but also to set 


realistic expectations of what the Board can actually achieve.” 
Il. PANELS AND DECISIONS 


Facebook has proposed that smaller panels, not the Board as a whole, 
will hear and deliberate on cases. Feedback was varied on the exact size 
of the panels. Some respondents also suggested that the Board may 
need to convene en banc to hear cases where panels disagree. On panel 
assignment, opinion was also divided; options could include randomized, 
thematic, and/or regional panels. With regard to the latter, some 
strongly suggested regional or national panels, while others expressed 
concern that this would risk bias, balkanization and/or state capture. 
Regardless, the Board will issue public explanations of their decisions; 
opinions diverged whether these should be attributed (for reasons 

of transparency) or anonymous (for reasons of safety, as well as the 
Board’s unity of purpose). 


Facebook’s Draft Charter proposed that cases be heard by smaller, subsets of Board 
members."* The practicalities of this proposal are implied: some 40 Board members 
would be very difficult to convene for every review. Given that the Draft Charter 
provides only a suggested approach, many details of how these panels would convene 
and hear cases were left open for consultation. 


Regarding panel size, some suggested three members for so-called *ordinary 
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decisions" and larger panels for difficult ones; ^ others simply recommended an odd 
number of panel members that could range anywhere from three to nine.’ Some 
issues, especially in cases where panels disagree with one another, may require the 
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Board to meet en banc, with a final decision coming from the Board as a whole. 


As for the composition of the panels, some recommended that panels be assigned 


randomly.” 


Others suggested to arrange them thematically, in order to leverage 
the types of expertise within the Board; "^ for example, panels of experts could be 
formed specifically to deal with hate speech. Alternatively, panel assignment could 


factor in regional representation, "^ 


especially for cases that heavily involve an 
understanding of local context, cultures, and norms." 
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While some advocated for entirely regional or national boards,"? others worried that 
such an arrangement would increase the risk of bias and influence or co-optation 

by States." Facebook itself has expressed some caution over a regionalized approach. 
In one conversation about the Oversight Board, a Facebook representative explained: 


“If we had different rules for different countries ... there could well be a sense in 


“If, as part of this oversight board, 
there will be reasoned decisions that ce aac 
will be published, we think that 


which you get to a lowest common denominator where countries ... with more 
restrictive legal regimes would affect in a big way content that might be available 


in other countries."? 


As a middle ground, panels could include a mix of regional and non-regional 
representation, which could “keep [the] focus on universal rights,” rather than just 
local issues."' At the same time, a number of observers also pointed to dysfunction 
within certain multilateral organizations as a model that should be avoided.'* 


Whether randomized or thematic, regional or global, these panels are expected to 
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issue public explanations of their decisions, as stated in the Draft Charter." Asone 
commentator observed, “If, as part of this oversight board, there will be reasoned 
decisions that will be published, we think that that is a step in the right direction." "* 
Other ideas for transparency include a 
review period for assessing user opinions, 
as well as an impact analysis to assess 
whether the Board's decisions align with 


public expectations of the Board's duties 
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While citing security and privacy concerns 


of Board members, Facebook indicated that 


that IS a step in the right direction.” panels will issue their decisions without 
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attribution.^* Trade-offs would be required 
to balance transparency, security, and 
privacy; feedback in this regard was split. 
Some argued that anonymity on panels 
could contribute to a culture of collective and consensus-based decision-making by 
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the board," while also increasing the likelihood of impartiality and objectivity. 


Facebook has also suggested that, “[s]hould a panel decision not be unanimous, a 
member who is in the minority may include his or her perspective as part of the 
explanation shared." This presupposes decision-making by majority rule. Should 
unanimous decisions not be required, many recommended allowing dissenting 
opinions as a mechanism to ensure transparency and public debate.’ Others 
supported dissents as a practical measure, given that the type of people chosen 
for the Board will likely “not be quiet if they disagree." '* 


However, dissents are not universal practice, and some preferred that panels come 
to decisions “as far as possible, on the basis of consensus.” This would perhaps 
ensure a greater unity of purpose, as well as a commitment to deliberative decision- 
making by the Board. At the same time, some felt that Board members will “rarely 
[be] likely to come to a unanimous ruling,” given the difficult nature of the cases that 


would be presented.’ 


IIl. INFORMATION FROM FACEBOOK AND THIRD PARTIES 


Facebook will need to provide information to the Board as part of 

its deliberation and decision-making. Some believed strongly that this 
contact should be strictly limited, with a strong wall of separation 
between the Board and Facebook staff. Others felt that some degree 
of interaction would be inevitable, perhaps even preferable. At the 
same time, the Board may require additional independent information 
and advice; a common suggestion was to develop a roster of 
independent experts who could provide background on both cultural 
context, as well as technical matters. Separately, additional stakeholders, 
such as civil society organizations, may wish to present their own 

views to the Board. Feedback was split on the value of allowing outside 
arguments (i.e. amicus briefs) to be submitted by third parties. 


In order to make decisions, the Board will need to have access to information from 
Facebook. During consultations, a number of interlocutors asked questions regarding 
how information sharing between Facebook and the Board would be structured and 


carried out. 


Some advocated for limited communication between the Board and Facebook staff. 
“Board members,” it was argued, “should not be permitted to preview their decisions 
with Facebook employees ... and Facebook employees and leadership should not be 
permitted to provide input on cases before deliberations have concluded anda 


decision has been reached.” ^ 


Conversely, others felt that *Facebook should not attempt to build a wall between 
the Board and its staff,” given that “[s]ome interaction between Facebook staff 
and the Board .. is going to be inevitable.” It would be necessary for panels to 
be able to request information from Facebook when necessary and interview 
Facebook staff as part of a proposed “fact-finding function,” as long as appropriate 


“whistleblower protections" were included." 


In addition, many felt that the Board would need independent expertise at their 
disposal, especially when reviewing content whose meaning and impact was highly 
dependent on local context. Interlocutors generally recommended “supplementing 
the board itself with a network of experts to ensure that the necessary linguistic, 
cultural, and socio-political expertise is available when the board makes a decision." '* 
Multiple workshop and roundtable participants suggested the development of a 
roster or pool of experts, which the Board could then call upon as needed.” 
Another suggestion was to include technical experts who could advise the Board 


on the feasibility and scalability of its recommendations." 


27 


As for seeking additional inputs from other third parties, many supported a mechanism 
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for “pertinent stakeholders" "' to present their views to the Board." On the whole, 
both advocacy groups and workshop participants supported the proposal for 

the Board to build a mechanism to accept “expert third party opinions,” ? similar 
to amicus briefs." Balance will be required, however, in order to guard against an 
amicus process devolving into a mechanism for professional lobbying or unfair 


influence by well-resourced organizations.” 


Along these lines, others warned that allowing amicus briefs could potentially introduce 
a bias, given that organizations from the Global North may have more capacity and 
resources to formulate submissions to the Board."^ One proposal suggested that 
Facebook should provide dedicated resources to support stakeholders who otherwise 
could not “afford to dedicate their time to the consultations related to the board at 
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their own cost. 
IV. PRECEDENT 


The Draft Charter has left room for debate with regard to precedent for 
Board decisions. On the whole, feedback supported decisions with some 
precedential weight, as long as the Board can balance both coherence 
and flexibility. Most felt that the Board should, as a default, defer to its 
past decisions; however, precedent should not necessarily be 
determinative. 


The Draft Charter does not include explicit language on precedent; it simply states 
that “Board decisions are binding on the specific content brought for review 
and could potentially set policy moving forward." * This description left ample 


room for debate. 


Overall, feedback generally supported some sort of precedent-setting arrangement. 
Most expressed hope that the Oversight Board could support “some idea of ... 


2179 


continuity, some idea of stare decisis” '” that could evaluate “multiple fact patterns 
and have some precedential weight." Response from the public questionnaire 
suggested the same. The majority of respondents (66%) stated that “considering 
past decisions is extremely to quite important,” while almost a third (28%) consider 
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past decisions as *somewhat important". 


Others felt that precedent would need “to be considered carefully, as ... there will 

need to be overruling rules articulated in order to reverse panel decisions that are later 
seen to be out of step with changing circumstances." ^ Furthermore, it was argued, 
“a strict coherence rule may cause a situation where the first panel to discuss a certain 
issue might set a standard that may not be reconsidered later. This will create a sense 


of arbitrariness and stagnation.” '* Others argued that since social media is a rapidly 


changing industry, "* precedent should not prevent review of future, similar content. 


In the end, many argued for balance: an understanding of precedent that would help 
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ensure consistency but not necessarily be determinative. 
V. POLICY INFLUENCE 


A strong consensus emerged that the Board’s decisions should influence 
Facebook’s policy development. Without some policy influence, 

the Board would not be seen as valuable or legitimate. While some 
expected the Board to make binding policy decisions, others understood 
the practicality of non-binding advisory opinions. Others also wished 
the Board to raise policy issues proactively, separate from the review of 
(and deliberation on) an individual case; similarly, the Draft Charter 
indicated that Facebook may bring policy questions before the Board. 
Most expect transparency and accountability with regard to Facebook’s 
implementation of Board decisions. Likewise, should the company 
decline to implement a decision, there is an expectation that it should 


also explain its rationale in writing. 


Feedback strongly favored the Board’s ability to have influence over Facebook’s 
policy. For example, 95% of respondents from the public consultation reported that 
“the Board should be allowed to recommend changes to Facebook rules and policies.” 
Without some influence over Facebook’s Community Standards, some wondered: 
“What’s the point of having the Board just duplicate content review?" * Or 
alternatively: *If Facebook isn't learning and fine tuning along the way, then why even 


establish this process at all?" ^? 


By and large, commentators supported the Board issuing policy recommendations. 
Some even preferred these recommendations to be binding.” In the Draft Charter, 
Facebook indicated that the Board's decisions 
will influence future policy development, while 
noting that it will remain “ultimately 


“If Facebook isn't learning and fine 


responsible for making decisions related to 


tuning along the Way, then why even policy, operations and enforcement." ™ Some 
í advocacy groups expressed concern that this 
establish this process at all? could be taken as “an intent to exonerate 


Facebook from any meaningful commitment to 
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the independent oversight mechanism. 


At the same time, others recognized the practicalities of the Board issuing advisory 
recommendations only. The Board "shouldn't mandate policy changes,” it was 


argued, as Facebook should still hold the responsibility of writing and implementing 
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its own policies."” In addition, binding policy changes may not always be advisable, 

as that would put the Board in a regulatory position that it may not have the technical 
expertise to support.’” Finally, observers noted, situations may arise wherein the Board 
issues a decision that is genuinely out of step with Facebook’s commercial interests 
(and/or with the majority of Facebook users). In such contexts, Facebook would need 
to resolve both its responsibilities to implement the Board’s decisions with “its 
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fiduciary duties to its shareholders. 


As for how the Board's recommendations would be formulated, some felt that 
advisory opinions would be helpful both reactively and proactively. In other words, 
the Board should make policy recommendations both in response to individual 
cases of disputed content and in response to new and emerging issues, unconnected 


to specific appeals. As one respondent from the public consultation wrote: 


To ensure that the Board is genuinely an "oversight" body, it should not be 
restricted in reviewing Facebook's content policies only when a particular case 
has reached it for review. Instead, it should be able to proactively monitor 

the policies and their enforcement, and make recommendations about any 
policy changes as and when it feels necessary. This ability would allow the Board 
to be more dynamic and responsive to new or changing situations, and would 
benefit Facebook by allowing the Board to raise potential issues to Facebook 


before problems arise (or increase in scale) when content decisions are made." 


Similarly, Facebook itself has also indicated that it may raise policy questions 
proactively, untethered from individual pieces of disputed content. In the Draft 
Charter, for example, the company has signalled already that it *may request 


policy guidance from the board.” 


Regarding implementation, the expectation is that Facebook would be held 
accountable for explaining publicly how it acted on the Board's guidance. “Asa 
minimum,” it was noted, “Facebook should respond to the Board's comments letting 
it know why, why not, and how Facebook decided to adopt the recommendations." "° 
In some cases, for example, the Board may suggest a policy change that is not 
technically feasible. In this context, Facebook could *decline to adopt the board's 
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recommendations" — but, in doing so, it should set out its reasoning in writing. 


See next page. 
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The Oversight Board and Facebook’s policy development 


Facebook “can incorporate the board’s decision in the policy 
development process” and “may also request policy guidance for 


the board.” That’s a good starting point, but it isn’t enough. 
- Public Knowledge 


The board should play a meaningful role in developing and modifying 
policies... As an oversight board, and given that content moderation 
decisions are ultimately made on the basis of the policies which underpin 
them, it is critical that the board has a clear and meaningful role when it 
comes to developing and modifying those underlying Terms of Service / 
policies. For example, the board must be able to make recommendations 
to Facebook and be consulted on changes to key policies that significantly 
impact the moderation of user content...Providing the board with such 
policy-setting authority would also help legitimize the board, and ensure 
it is not viewed as simply a mechanism for Facebook to shirk responsibility 
for making challenging content-related decisions. 


- Joint Statement from multiple signatories 


In order for the Board to be an effective entity that can promote fairness 
and respect for human rights in Facebook's content takedown practices, 
it must be able to both review content takedown cases and provide 


meaningful input on policy development. 
- Open Technology Institute 


We believe that the board has a critical role to play in supporting the 
development of Facebook’s policies relating to content moderation, 
and that this should be more explicitly detailed in the final charter. 

We recommend, in particular, that the board be able to proactively 
recommend changes to Facebook's content moderation policies, both 
through its decisions and of its own volition if there are particular 
issues which the board feel should be brought to the attention 

of Facebook. While we do not recommend that Facebook be bound by 
any recommended changes, it should publicly respond to them and 


set out why it will or will not follow any recommendations. 
- Global Partners Digital 


A board can resolve mistakes in individual cases when existing appeals 
processes have failed, but it can't do this at scale. The real value of the 
Oversight Board is in its ability to identify persistent, systemic problems 


and to recommend changes to policy. 
- Digital Social Contract 


Así, proponemos un cambio de la idea original planteada en el borrador 
de Facebook, y planteamos directamente que el “Oversight Board" tenga 
la facultad de impactar directamente el disefio regulatorio de las políticas 
de contenido de la misma plataforma. 


- Joint Statement from Latin American and 
Caribbean Civil Society Organizations (See Appendix D) 


C. Governance 


I. INDEPENDENT JUDGMENT 


The Oversight Board's ability to exercise independent judgment will be 


critical for its efficacy and legitimacy. While some felt that compensation 


was not appropriate and/or necessary, most agreed that Board members 


should receive remuneration for their time and expertise. One recurring 


recommendation, aimed at separating Facebook-provided funding from 


influence over the Board's decisions, was to establish an independent 


trust. The company has already indicated that it is doing so. Feedback 
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Supervision 
of Operations 


41.7% 


of public consultation 
respondents said the Board 
should supervise its own 
operations. 


23.6% 


said operations should be 
supervised, administered, 
and supported by a nonprofit 
or nongovernmental 


organization. 


was varied with regard to the Board’s incorporation, whether that be 
through a fully independent entity, an NGO or university, or some 
structure still somehow connected to Facebook. Separately, observers 
expressed concern over possible state influence over the Board, which 
would need to be managed carefully. 


The Draft Charter has asked how Facebook can ensure independent judgment, 

which it defines as “inappropriate or undue influence from Facebook or any other 
external sources.""? Feedback in this regard has focused primarily on three main 
issues: compensation of Board members, the Board’s relationship with Facebook, 


and influence by States. 


Regarding compensation, a few disagreed with Facebook’s position in the Draft 
Charter. They felt that service on the Board should be a voluntary position, given that 
“he who pays the piper calls the tune.”*"' The majority of others, however, argued 
that experts should be remunerated for their time and effort, but that compensation 
should be fixed and standard, as well as structured in such a way that Facebook 


cannot revoke resources in response to Board decisions." 


One suggestion included 
having Facebook "fund the board's compensation and its supporting staff by awarding 
an annual budget figure that is commensurate with Facebook's evaluation of the 
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board's value. 


Commentators generally supported the idea of “platform oversight bodies ... [that 
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are] financially independent,” ^" and the most common suggestion in this regard 
was the establishment of a separate trust, endowment or foundation.^? In response 
to this feedback, Facebook has already stated publicly that the development of a 


trust is underway." 


In addition to compensation, some respondents from the online consultation 
supported the establishment of a totally *independent entity based somewhere 
besides Menlo Park, Calif."^" Suggestions included housing the Board within 
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a university," NGO*” or some other third-party organization." However, others 


found this arrangement to be “just too convoluted”*" and worried that the 
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choice of a third party organization would introduce bias. 


Even some critics acknowledged the need for some close working relationship 
between the Board and Facebook. As one wrote, *Ensuring the Oversight Board's 
independence is critical — yet that independence will mean nothing if Facebook 
staff is so far removed from the decisions that it could easily ignore the 
recommendations and/or fail to enforce the outcomes, or if implementing those 
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decisions is regularly frustrated by ...the company’s leadership. 


In addition to the relationship with Facebook, the Board’s ability to make independent 


decisions will also hinge on its relationship — or lack thereof — with third parties. 
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Many workshop and roundtable participants (especially in smaller countries and 
across the Global South) expressed concern over influence from powerful state 
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governments*™ and even the possibility of state capture.” “How will foreign 


governments,” one roundtable participant asked, “rally to influence this body and 
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their members? It is scary when one thinks of lobbying from governments. 


Others worried about pressure from both government regulation of the Board’s 
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activities, as well as pressure from businesses." Many did not want to see the 


Oversight Board produce a cottage industry for professional lobbying,” either by 
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states or by well-resourced interest groups. 
Il. BOARD ADMINISTRATION AND STAFF 


Facebook's Draft Charter has suggested that the Board will have support 
from a full-time staff. This proposal raised many questions, especially 
with regard to the staff's duties, functions, and responsibilities. 

Some worried that the staff would wield outsize power over the Board; 
a number of commentators strongly preferred a staff that is wholly 
separate from Facebook. At the same time, others assumed that this 
staff would simply be Facebook employees or, at the very least, have 
institutional knowledge about the platform's content moderation and 


enforcement procedures. 


The Draft Charter affirms that the Board will be supported by a full-time staff 
that will provide support and ensure the implementation of its decisions; this staff 
will not be part of the Board itself." Throughout the consultation period, 
interlocutors highlighted the "potentially significant role" this staff would play, 


while calling for the revised Charter to include more “detail on the role and 
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powers that this staff will have. 


There was a general consensus that the Board would need staff support, in order to 


help review cases and liaise with Facebook regarding the implementation of decisions,” 


while also ensuring that potential cases meet certain procedural requirements.” 
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Other functions could include assessing amicus briefs," reviewing past Board 


decisions,” conducting general research,” serving as rapporteur" liaising with 
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government interlocutors,” and generally relieving Board members of “onerous 


2» 229 


administrative tasks that will detract from the board's purpose. 


Some saw the Board's staff as a secretariat function; others compared it to a judicial 
clerkship. In the case of the latter, some observers expressed concern that the 
Board's staff could “wield immense power,” especially if they were to be involved in 
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drafting decisions and deciding on case selection.” Others pointed out a potential 


imbalance between part-time Board members and full-time staff, which could 
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result in the latter actually “hold[ing] the power, because they will be the ones day 


in, day out, year after year doing this work." ^^ 


For this reason, observers by and large argued for the Board staff to be wholly 
independent of Facebook," perhaps with its own, separate offices. One 
recommendation even suggested that the Board establish its own Human Resources 
department, which could run “an open and global application process" for staff 
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selection — of which Facebook would have no part.?* Others, however, strongly 
discouraged the development of Board support structures that would simply add 


layers of unnecessary bureaucracy.” 


At the same time, others stressed that the Board's staff must include *knowledge, 
training and historical context to advise the Board members of established Facebook 
procedures."** While not explicit, this does imply that staff would either need to be 
Facebook employees, former Facebook employees, and/or observers with close, insider 
knowledge of Facebook's procedures for content moderation and enforcement. 

Still others considered that the Board's staff would just be *Facebook employees... 
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compensated according to standard Facebook company salary requirements. 
IIl. BASIS FOR DECISION-MAKING 


The Board will need to have a foundation for its decision-making. 

The Draft Charter indicated that this would include a set of values, 
but did not determine what those would be. In response, some have 
called for a "constitution" or *values commitment" — some form 

of statement of higher-order principles. Others urged that any list of 
values be clear on prioritization, in cases where different values come 
into conflict. Meanwhile, a strong contingent of human rights 
organizations urged that the Board simply adopt international human 
rights law as its basis for decision-making. Others felt this would not 
provide the necessary clarity and pointed to different interpretations 


of human rights norms across different regions and countries. 


As noted in the Draft Charter, *The primary function of the board is to review specific 
decisions we make when enforcing our Community Standards. It will base its decisions 
on these standards as well as a set of values, which will include concepts like voice, 
safety, equity, dignity, equality and privacy." ** In addition to these substantial values, 
some felt that procedural values, like due process and the right to be heard, would 


239 


be just as essential to clarify and codify. 


As some observed, more clarity may be required, so that these values are more 


meaningful than “just a bunch of buzzwords.” Thus, some have called for Facebook 
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to go beyond its existing values of “Safety, Voice, and Equity” ^" and instead adopt 


“something like a constitution: a code of fundamental principles that would be 
harder to amend than the company’s malleable content moderation rules."^* This 
“constitutional” concept is echoed by the original “Facebook Supreme Court” 
proposal, which recommended that the company adopt a single, formal, concise, 
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and public “values commitment. 


However, others have cautioned that such a list, without clear prioritization, would 
not be meaningful, since “the very nature of hard freedom of speech cases is 
that they involve trade-offs between these values.” “* Facebook itself, not the Board, 
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*must make the difficult choices about which values it wishes to prioritize. 


To address the concern about the underlying bedrock for its decisions, many 
proposed that the Board incorporate international human rights norms and standards 
into its core decision-making functions.^" This suggestion recurred at the vast 
majority of workshops and roundtables, often with an admonishment to Facebook 
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not *to reinvent the whee 


A number of civil society groups have also publicly encouraged the Facebook and 

the Oversight Board to adopt human rights principles as its guiding values. These 
groups include, inter alia, Article 19, Access Now, Bonavero Institute of Human Rights, 
and Global Partners Digital, as well as the United Nations Special Rapporteur on the 


promotion and protection of the right to freedom of opinion and expression. 


These advocacy groups have also noted that Facebook is a member of the Global 
Network Initiative and, “[w]hile Facebook is not legally bound by international human 
rights laws, the UN Guiding Principles on Business and Human Rights set out 
responsibilities that companies like Facebook have to respect human rights."^? In 
particular, it was proposed that Article 19 of the International Covenant on Civil 

and Political Rights (ICCPR) would "provide the oversight board with a set of tools and 
a ‘common vocabulary’ for addressing and resolving hard questions around 


the moderation of online content.” 


At the same time, others felt that focusing exclusively on a human rights framework 
would not be enough to adjudicate hard cases. More practical and operationalizable 


guidance would be needed. As one observer noted: 


The concrete way these human rights principles would be implemented — and 
reflected — in both the [Oversight Board] mandate and the Community 
Standards (CS) is an overlooked issue by many civil society groups. Would the 
implementation of this framework affect, for example, the way Facebook 


balances users’ security and trust against freedom of expression? ^" 


Furthermore, as others pointed out, "International human rights norms are not a 


panacea for the intractable problems of online speech regulation,” as human rights 
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law is not “a single, self-contained and cohesive body of rules.”*” Instead, “these laws 
are found in a variety of international and regional treaties that are subject to differing 
interpretations by states that are parties to the convention as well as international 
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tribunals applying the laws. 


Similarly, others noted the various interpretations of human rights standards 

across different countries and regions, expressed concern about a bias from the 
Global North, and wondered if these would provide the clarity needed for the 
Oversight Board's decisions.** As one workshop participant asked, “Have you seen 
one single country that is just ruled solely by human rights? No, because you need ... 
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additional standards. 


In short, while Facebook is “not required by international human rights law to 
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provide a home for all opinions,” ™* supporters of a stronger focus on human rights 


principles argue that, overall, *the advantages of aligning corporate speech codes 
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with international human rights law outweigh the potential disadvantages. 
IV. SCOPE 


Facebook has set out that the Board’s scope will be content governance; 
this is indicated even in the subtitle of the Draft Charter. However, 
many have wondered whether the Board could also hear other policy 
issues, such as algorithmic ranking, privacy, local law, Al, monetization, 
political ads, and bias. On legal questions, for example, many have 
pressed for issues of local law to be included under the Board’s remit. 
Facebook, meanwhile, has explained that it will not be in scope. 
Expectation management will be key, as different understandings of 

the Oversight Board — some limited, some capacious — will need 

to be resolved. 


The subtitle of the Draft Charter — “An Oversight Board for Content Decisions” 
— made clear that this body would focus specifically on content. In this regard, 
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Facebook has been relatively clear about the Board’s scope and remit. 


However, throughout the consultation period, interlocutors often proposed that the 


Board hear a wide range of controversial and emerging issues: newsfeed ranking,” 
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data privacy, ^? issues of local law,” artificial intelligence," advertising policies, 


and so on. 


In addition to content decisions, the Draft Charter also foreclosed the Board from 
deciding cases “where reversing Facebook's decision would violate the law.”*™ This 
was seen as an “understandable” limitation but also one that “does give governments 


de facto control over the [Board's] remit.” ™ Some felt strongly that “companies 
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accede too quickly to government requests,” ^^^ and the Board should serve as a forum 
for discussion on such issues. However, the company has been clear in this regard, 


and as one Facebook representative stated: 


The Board, and were very intentional on this, will not actually be about making 
those decisions that are legally prohibited country by country, and the reason 
for that is that we actually cannot confer on the board greater authority than 
Facebook itself has. We, as a company, [respect] the laws of different countries 
and different places .. this is really a delegation of authority and part of how 
were envisioning exercising our responsibility, and we actually can't go beyond 


those lines. ^^ 


Nonetheless, observers would like more information on how the Board will interact 
with local law — as well as a host of other issues. These range from algorithmic 
downranking to political ads, from election interference to privacy, from platforming 
to political bias. This feedback suggests that Facebook still needs to communicate the 
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“level of ambition"** it expects out of the Board — while managing expectations over 


what a 40-person body could possibly achieve. 


The question persisted: should the Board be restricted to content decisions only, 
without much real influence over policy? If so, “What’s the point of having the Board 
just duplicate content review?"^? Or is the establishment of the Board — already 
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described as a “constitutional moment” ^? — a “very ambitious project, maybe too 
ambitious" for it to be successful?" As one workshop participant explained, “One 
of [the Board's] biggest risks is overthinking this...[it’s] not going to please everyone, 
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so the Board should get it approximately right and then adjust. 


In the end, balance will be needed; Facebook will need to resolve tensions between 
minimalist and maximalist visions of the Board. Above all, it will have to demonstrate 
that the Oversight Board — as an enterprise worth doing — adds value, is relevant, 


and represents a step forward from content governance as it stands today. 


See next page. 
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IV. Conclusion 


This report has only been possible thanks to the effort, acuity, and honesty of a 
diverse group of scholars, experts, and interested people who took the time to 


analyze and engage in conversation on Facebook's plans. 


But building an institution like the Oversight Board is the work of years, not months. 
The issues raised during this initial consultation period and discussed in this report 
are not exhaustive, nor could they be. The design of the Board is still only a first step. 
How it works in practice, and how it is improved when it doesn't work, will determine 


the real value of this or any similar enterprise. 


Facebook finds itself in a historically unique position. It cannot deprive or grant 
anyone the freedom of expression, and yet it is a conduit through which global 
freedom of expression is realized. As Facebook continues to build out the Oversight 
Board, and make decisions on its architecture and values, it will need — and will 
look for — the continuing input of the community that has provided feedback for 
this report. 
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Washington D.C. roundtable participant; New Delhi workshop 
participant; Berlin workshop participant. 

Untitled paper from the Center for Studies on Freedom of 
Expression and Access to Information (CELE). 

Nairobi workshop participant. 

Singapore workshop participant; Bratislava roundtable participant; 
New York City workshop participant. As noted by Article 19, 
"preventing current or former Facebook employees from serving ... 
[is] an important start.” See “Facebook oversight board: 
Recommendations," Article 19. 
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Draft Charter: An Oversight Board, Facebook, 5. 

Singapore workshop participant; Geneva roundtable participant; 
Zagreb roundtable participant. 

Brussels roundtable participant. 

Oversight Board to Review Facebook's Content Decisions, Global 
Partners Digital, 4. 

New York City workshop participant. 

Facebook's Oversight Board for Content Decisions Must 

Promote Greater Transparency, New America's Open Technology 
Institute (OTI). 
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Washington D.C. roundtable participant; Brussels roundtable 
participant. 

Draft Charter: An Oversight Board, Facebook, 5. 

“Facebook oversight board: Recommendations,” Article 19. 

Brussels roundtable participant. According to Kevin Wei, respondent to 
he Facebook Oversight Board Consultation,, “the Board should also 
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Draft Charter: An Oversight Board, Facebook, 4. 

Singapore workshop participant. 

Singapore workshop participant. 
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The values of “safety,” “voice” and “equity” are presented in the 
Community Standards. They are used to formulate policies along with 
efforts to also “base ... policies on input from our community and 
from experts in fields such as technology and public safety." As 
stated, “the goal of our Community Standards is to encourage 
expression and create a safe environment." See Community 
Standards, Facebook, https://www.facebook.com/ 
communitystandards/introduction. 
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Zuckerberg, “A Blueprint for Content Governance.“ 

Douek, “Facebook’s ‘Oversight Board: Move Fast,” 10. 
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